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The auditory cortex represernts spatial locations differently fronn other sensory modalities. 
While visual and tactile cortices utilize topographical space nnaps, for audition no such 
cortical map has been found. Instead, auditory cortical neurons have wide spatial receptive 
fields and together they form a population rate code of sound source location. Recent 
studies have shown that this code is modulated by task conditions so that during auditory 
tasks it provides better selectivity to sound source location than during idle listening. 
The goal of this study was to establish whether the neural representation of auditory 
space can also be influenced by task conditions involving other sensory modalities than 
hearing. Therefore, we conducted magnetoencephalography (MEG) recordings in which 
auditory spatial selectivity of the human cortex was probed with an adaptation paradigm 
while subjects performed a visual task. Engaging in the task led to an increase in 
neural selectivity to sound source location compared to when no task was performed. 
This suggests that an enhancement in the population rate code of auditory space took 
place during task performance. This enhancement in auditory spatial selectivity was 
independent of the direction of visual orientation. Together with previous studies, these 
findings suggest that performing any demanding task, even one in which sounds and their 
source locations are irrelevant, can lead to enhancements in the neural representation of 
auditory space. Such mechanisms may have great survival value as sounds are capable of 
producing location information on potentially relevant events in all directions and over long 
distances. 
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INTRODUCTION 

The way the auditory system represents location constitutes a 
major deviation from how space is represented in other sensory 
modalities. In the cortex, neurons form topographical maps of 
visual and somatosensory locations but for audition, no such 
map has been shown to exist (see, for instance, Werner-Reiss 
and Groh, 2008). Also unlike in vision and touch, the input the 
auditory system receives is not inherently spatial in nature: the 
perception of sound source location is based on subtle acousti- 
cal cues that the path from the source to the ears imposes on the 
sound (Middlebrooks and Green, 1991). A topographical map of 
auditory space could still be generated through neural computa- 
tions but this does not appear to take place (Grothe et al., 2010). 
Instead, the auditory cortex uses a population rate code for rep- 
resenting horizontal sound source location (Stecker et al., 2005; 
Werner-Reiss and Groh, 2008; Salminen et al, 2009, 2012; Magezi 
and Krumbholz, 2010; Briley et al, 2013). In this hemifield or 
opponent code, horizontal sound source location is represented 
in the activity of two widely tuned populations, one preferring 
sounds in the left and the other those in the right hemifield of the 
auditory space. 

The population code of sound source location is influenced by 
the state of the subject. In a recent study on the auditory cortex of 



behaving cats, the spatial selectivity of single neurons depended 
on task conditions (Lee and Middlebrooks, 2011). When the 
cat was engaged in a listening task, the spatial receptive fields 
were smaller than during idle listening. More specifically, neurons 
that had very wide receptive fields, sometimes spanning nearly 
the entire auditory space, became narrower resulting in recep- 
tive fields the size of a little less than half the auditory space. 
This means that the neurons had a higher level of spatial selec- 
tivity during the task than during idle listening. This increase in 
the number of neurons producing useful information on spatial 
location occurred both during pitch and location detection tasks 
although the increase was slightly larger when the task required 
location detection. The results of a previous study combining 
magnetoencephalography (MEG) and functional magnetic reso- 
nance imaging (fMRI) techniques suggests that such changes in 
auditory spatial sensitivity may also take place in the human audi- 
tory cortex (Ahveninen et al, 2006). Responses were recorded 
to changes in sound source location and the amplitude of the 
response was used as a measure of neural selectivity to location. 
The subjects performed tasks that required the detection of sound 
source location or the identity of a speech sound. During the 
spatial task, response amplitudes to changes in sound source loca- 
tion were larger than during the speech task. This suggests that 
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neural selectivity to spatial location was at a higher level when the 
subjects paid attention to sound source location. 

Another form in which neural responses to spatial sound 
may change due to task demands has been described in previ- 
ous electroencephalography (EEG) studies. When sounds occur 
in locations to which attention is directed, they lead to larger 
response amplitudes than sounds that occur in unattended loca- 
tions (HOlyard et al, 1973; Teder-Salejarvi and Hillyard, 1998). A 
similar gain effect can also be induced crossmodally. For instance, 
when attention is directed to visual stimuli in a given location, 
sounds occurring in the same location induce larger negativity in 
the event-related potentials (ERPs) than sounds occurring out- 
side the focus of visual attention (Eimer and Schroger, 1998; 
Teder-Salejarvi et al., 1999). It is not clear whether this increase 
in response amplitude is due to the activity of spatially selective 
neurons and whether the widely-tuned neurons typically found 
in the auditory cortex are even capable of producing increases in 
response amplitude specifically for a single sound source direc- 
tion. Since no neurons in the auditory cortex appear to be 
dedicated to narrow ranges of locations, such increments could 
not be generated by simply increasing the activity level in a subset 
of spatially selective neurons. 

In summary, the state of the subject can induce two kinds of 
changes in cortical activity to spatial sound. First, performing a 
task related to sounds and their source locations enhances spatial 
selectivity. This enhancement does not appear to occur exclusively 
for a single attended location but instead applies to all spatial 
locations equally, although this has not been tested explicitly in 
previous studies. Second, focused spatial attention leads to a gain 
effect, that is, an increase in response amplitudes specifically for 
sounds occurring in an attended spatial location. The gain effect 
can be induced also crossmodally. However, the enhancement in 
spatial selectivity has been demonstrated only during auditory 
tasks. Therefore, the goal of the present study was to establish 
whether the enhancement in selectivity to sound source loca- 
tion in auditory cortex can be induced crossmodally by a visual 
task. Additionally, we explored the possibility that this enhance- 
ment may depend on the direction of visual orientation. To this 



end, we evaluated spatial selectivity in the human auditory cor- 
tex utilizing an adaptation paradigm in MEG. The same auditory 
stimulation was repeated during visual tasks and while no task 
was performed. 

MATERIALS AND METHODS 
SUBJECTS 

Fourteen subjects (mean age = 24, SD = 2.8, 7 female) with nor- 
mal hearing and normal or corrected-to-normal vision took 
part in the experiment. Written informed consent was obtained 
from each participant and the experiments were approved by the 
Ethical Committee of Helsinki University Central Hospital. The 
data of one subject were discarded due to poor signal-to-noise 
ratio. 

STIMULI AND PROCEDURE 

The sound stimuli were 200 ms bursts of white noise presented 
through headphones. Three virtual locations in the horizontal 
plane, one to the left (—20°), one directly in front (0°), and one 
to the right (-1-20° ) were generated by filtering the sounds with 
corresponding head-related transfer functions (from a database 
provided by Massachusetts Institute of Technology: http://sound. 
media.mit.edu/resources/KEMAR.html). 

The sound stimulation followed a stimulus-specific adaptation 
paradigm (Butler, 1972; Salminen et al., 2009). In this paradigm, 
sounds are presented from two alternating locations: the probe 
and the adaptor, and the effect the location of the adaptor has on 
the response to the probe sound is recorded (Figure 1). The probe 
remains in the same location while the adaptor location is varied. 
When the two sounds are presented in the same location, small 
response amplitudes are found for the probe sound. However, 
when a spatial separation is introduced between the sound source 
locations, the probe gives rise to larger response amplitudes. This 
can be interpreted in terms of spatial selectivity of auditory corti- 
cal neurons. When the probe and the adaptor are presented in the 
same location they activate the same population of spatially selec- 
tive neurons. This leads to high levels of attenuation and small 
responses. When the probe and the adaptor occur in different 
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FIGURE 1 I Selectivity to sound source location in the human 
cortex was recorded with a stimulus-specific adaptation 
paradigm. A probe sound was presented to the left of the subject 
and adaptor sounds to the left (A), in front (B), and to the right 
(C). Event-related fields were recorded to the probe sound. The 



Nlm response amplitude increased with growing spatial separation 
between the probe and the adaptor (D). Event-related fields averaged 
over 13 subjects and over the three task conditions are depicted 
from the gradiometer showing largest Nlm amplitudes over the right 
auditory cortex. 
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locations, they activate a partially different set of spatially selec- 
tive neurons. Then, the spatially selective neurons are more likely 
to respond differently to the two sounds and experience a longer 
interstimulus interval. This leads to less attenuation and larger 
response amplitudes. In this study, the probe was always at —20° 
while the location of the adaptor was either —20°, 0°, or +20°. 
Each adaptor condition was confined to a dedicated stimulation 
block resulting in three blocks for each task condition. Sounds 
were presented at an interstimulus-interval (onset to onset) of 1 s. 

During the visual task conditions, subjects were presented with 
visual stimuli projected on a screen at a distance of 93 cm from 
the subject. The stimuli were solid-color circles of 3.7° diame- 
ter located 20° to the left or right of the midline. The circles 
were presented sequentially for a duration of 150 ms at an inter- 
stimulus interval of 650 ms. The timing of the visual stimuli was 
arranged so that their onset did not coincide with the onset of 
the sounds. Six colors were used (white, red, purple, blue, green, 
and yellow) and the task was to indicate by a button press when 
two subsequent circles of the same color occurred. Attention was 
maintained in the same direction (left or right) throughout each 
stimulation block. The subjects were encouraged to overtly ori- 
ent to the visual stimuli by directing their gaze either to the left 
or right. A cross was presented directly in front and the subjects 
were instructed to orient their head so that their nose was point- 
ing toward the cross. Head position was monitored with coils 
attached to the head. In an additional control condition, the sub- 
jects read a self-selected text and were instructed to ignore all 
stimulation. The purpose of this condition was to record brain 
responses while the subject was in a relaxed state but still main- 
taining sufficient alertness for brain recordings. This provided the 
possibility of evaluating the contribution of general attentive state 
of the subject. During all conditions, the subjects were instructed 
to ignore the sound stimulation. 

The experiment comprised altogether nine stimulation blocks: 
the three adaptor conditions (—20°, 0°, or -|-20°) were repeated 
for each task condition (left, right, control). The experiment 
always began with three task blocks, continued with three con- 
trol blocks and finally ended with the three remaining task blocks. 
Within these restrictions, the order of presentation was random- 
ized for each subject. 

DATA ACQUISITION AND ANALYSIS 

Data was acquired with a 306-channel MEG device (Vectorview, 
Elekta Neuromag, Finland) at a sample rate of 1000 Hz and a 
passband of 0.03-200 Hz. The event-related fields were averaged 
online from 100 ms prior to stimulus onset to 500 ms after. Large 
eye-movements and blinks were monitored with electrodes and 
deviations larger than 150 |iV in the electrodes or 3000 fT in 
the MEG data led to the automatic discarding of the epoch. A 
minimum of 150 repetitions were obtained for each stimulus con- 
dition. The event-related fields were then filtered at 1-30 Hz and 
baseline corrected with respect to a 100-ms prestimulus period. 

To quantify the overall level of activity in the auditory cor- 
tex, three pairs of planar gradiometers above the auditory cortex 
with the largest levels of activity around the Nlm latency range 
were chosen for further analyses for each subject and cortical 
hemisphere separately. The Nlm amplitude was quantified as the 



amplitude peak at the latency range of 80-140 ms in the average 
waveform of the three channel pairs. All data analysis was per- 
formed on these amplitudes. For illustration purposes, data was 
also averaged over all 13 subjects and the gradiometer showing 
largest Nlm responses was identified in the right hemisphere. 

The Nlm amplitudes were submitted to a repeated-measures 
analysis of variance with the repeating factors task condition (left, 
right, control) and adaptor location (left, front, right). Newman- 
Keuls post-hoc comparisons were performed when appropriate. 
The analyses of left-hemispheric activity did not yield any find- 
ings that reached or approached statistical significance. This was 
possibly due to the probe sound being always in the left hemi- 
field resulting in low levels of activity in the ipsilateral left cortical 
hemisphere. The right auditory cortex has been suggested to 
be more involved in spatial processing (Zatorre and Penhune, 
2001; Palomaki et al, 2005) and this may further account for the 
lack of systematic variations in the left-hemispheric responses. 
Therefore, only right-hemispheric activity is discussed in the 
results. 

RESULTS 

The response amplitude to the probe sound depended on the 
location of the adaptor indicating neural selectivity to sound 
source location [Figure 1; main effect of adaptor location: 
P(2, 24) = 20.7, p < 0.001]. Smallest responses occurred when the 
adaptor was at the same location with the probe in the left (—20° ) 
and largest when the adaptor was in the right hemifield (-1-20°). 
The response amplitude was intermediate for the adaptor location 
directly in front. The increase in response amplitude with grow- 
ing spatial separation occurred both during the visual task and 
when no task was performed. This pattern of location-specific 
adaptation is in line with previous experiments evaluating spatial 
selectivity with the adaptation paradigm (Butler, 1972; Salminen 
et al, 2009). 

The task condition influenced the rate at which the response 
amplitudes increased as a function of spatial separation between 
the probe and the adaptor [Figure 2; interaction between adap- 
tor location and task condition: F(4_ 43) = 2.8, p < 0.05]. The 
largest difference between the task conditions was found when 
the adaptor was in the right hemifield (at -1-20°), i.e., at the loca- 
tion furthest from the probe. Then, the response to the probe was 
33% larger during the performance of the visual task than when 
all stimulation was ignored (no task vs. right: p < 0.01, no task 
vs. left: p < 0.01, right vs. left: p = n.s.). A similar but smaller 
effect (10-20%) was found for the intermediate adaptor location 
in front but this effect did not reach statistical significance. There 
was a small difference between the two visual task conditions but 
this also failed to reach significance (p = 0.37). When the adap- 
tor was at the same location as the probe, no differences between 
task conditions occurred. In conclusion, spatial selectivity, sig- 
naled here by location-specific adaptation, was enhanced during 
the performance of the visual task. 

Interestingly, when both sounds were in the same location in 
the left, the response amplitudes were at the same level under 
all task conditions. This has two implications for the interpreta- 
tion of the results. First, the response amplitude to the sound in 
the left did not depend on whether visual orientation was to the 



www.frontiersin.org 



March 2013 | Volume 7 | Article 44 | 3 



Salminen et al. 



Visual task enhances auditory selectivity 



A Adaptor in the left 
20 fT/cm 



-100 ms 



B Adaptor in front 



Adaptor in the right 




-10 fT/cm 
Task condition: 



Left (-20°) Front (0°) Right (+20°) 
Adaptor location 



FIGURE 2 I Spatial selectivity was recorded under three conditions: 
when a visual task required orientation to the left or to the right and 
while the subject ignored all stimulation. Example event-related fields are 
depicted from the right-hemispheric gradiometer showing largest Nim 
amplitudes averaged over 13 subjects. When the probe and the adaptor were 
both presented in the left location, the three task conditions led to similar 
amplitudes of the Nlm response (A). When there was a spatial separation 



between the probe and the adaptor, larger responses to the probe were 
recorded during the visual task conditions than when no task was performed 
(B and C). Therefore, the increase in Nlm response amplitude to the probe 
was larger during the visual task condition than when the subject was not 
engaged in a task (D). This suggests that the spatial selectivity of auditory 
cortical neurons was enhanced during the performance of the visual task. 
Statistically significant differences are marked with brackets. 



left or to the right. This signifies that no gain effect occurred for 
the attended location. Second, there was no general increase in 
response amplitudes that would apply to all sounds during the 
performance of the task compared to idle listening. Therefore, 
the changes in response amplitudes occurring during task per- 
formance signaled enhancement in spatial selectivity rather than 
a general increment in neural responsiveness. 

DISCUSSION 

Here, we conducted an MEG experiment in order to determine 
whether orienting to visual stimuli could enhance the selectiv- 
ity of auditory cortical neurons to sound source location. We 
measured responses to spatial sounds in a stimulus-specific adap- 
tation paradigm while subjects were engaged in a visual task. As in 
previous studies (Butler, 1972; Salminen et al., 2009), the grow- 
ing spatial separation between sound sources led to an increase in 
response amplitudes reflecting neural selectivity to spatial loca- 
tion. This indicator of spatial selectivity was modulated so that 
the rate at which the response amplitudes increased as a function 
of spatial separation was higher during the visual task than when 
no task was performed. This suggests that attending to visual 
stimulation can enhance the spatial selectivity of auditory corti- 
cal neurons. This also provides an interesting demonstration on 
how attention in one modality can modulate the neural coding of 
stimulus features in another modality. 

The enhancement in spatial selectivity found here could possi- 
bly be explained by single neuron mechanisms similar to those 
described in a previous study of cat auditory cortical activity. 
In the previous study, the spatial receptive fields were found to 
change in response to engaging in a listening task compared to 
idle listening (Lee and Middlebrooks, 2011). During idle listen- 
ing, the receptive fields were wide, often covering more than half 
the auditory space. However, when the cat performed an auditory 



detection task, either related to sound source location or pitch, 
some spatial receptive fields became smaller, typically the width 
of a little less than half the auditory space. Such a change in the 
spatial receptive fields, if it took place also during a visual task, 
could account for the present findings. The narrowing of the spa- 
tial receptive fields would lead to a situation in which neurons 
that during idle listening are hardly selective to spatial location 
become spatially selective during the performance of a task. Then, 
more neurons would show spatial selectivity that contributes to 
the stimulus-specific adaptation to spatial location. This would 
give rise to a larger adaptation effect during active than passive 
conditions as was found here. Therefore, the present findings 
suggest that spatial receptive fields may become narrower during 
task performance also in the human auditory cortex and that this 
effect can be induced crossmodally. 

The enhancements in spatial selectivity found here were not 
specific to the direction of visual orientation. Further, in the 
previous cat study these enhancements occurred also during a lis- 
tening task in which spatial location was not relevant (Lee and 
Middlebrooks, 2011). This suggests that the changes in spatial 
coding in auditory cortex might not be exclusively due to atten- 
tion to spatial locations. Instead, they may be an outcome of 
a higher level of arousal during a demanding task than during 
idle listening. However, general arousal does not seem to have an 
effect on the sensitivity to other sound features than spatial loca- 
tion. Previous EEG and MEG studies have recorded sensitivity to 
changes in the frequency patterns of sounds during the perfor- 
mance of a visual task (for instance, Sculthorpe et al., 2008; Chait 
et al, 2011). These studies have found no enhancements in neu- 
ral sensitivity when the subject is engaged in a demanding visual 
task compared to idle listening or an easier task. This suggests 
that if general arousal is capable of enhancing auditory sensitiv- 
ity, the effect is specific to spatial selectivity instead of being a 
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general enhancement in all auditory processing. An enhancement 
in auditory spatial processing may have great survival value. The 
auditory system provides information on objects and events in 
locations outside the visual field and in distant locations. Based on 
this information other sensory modalities and motor functions 
can be directed. Therefore, in demanding situations causing an 
elevated level of arousal, enhanced processing of auditory spatial 
information may be beneficial. 

Here, the enhancement in spatial selectivity did not depend 
on the direction of visual orientation. Also to our knowledge, 
no previous reports exist on local enhancements in auditory 
spatial selectivity for attended locations in behavioral or neural 
experiments. Therefore, one may consider the possibility that the 
auditory cortex is not capable of providing such enhancements. 
In the auditory cortex, sound source location is represented by a 
population rate code that consists of two opponent populations, 
one tuned to the left and the other to the right hemifield (Stecker 
et al, 2005; Werner-Reiss and Groh, 2008; Salminen et al., 2009, 
2012). In this code, there are no single neurons dedicated to a 
restricted range of locations. Therefore, there are no single neu- 
rons whose selectivity could exclusively be enhanced to produce 
a local improvement in sensitivity. However, recent animal stud- 
ies have described an alternative mechanisms through which the 
population rate code might be able to target better selectivity to 
specific spatial locations. This has been described in subcorti- 
cal auditory neurons as an adaptation mechanism to stimulation 
statistics (Dahmen et al., 2010; Maier et al, 2012). In the wide spa- 
tial tuning curves, the best discrimination power between sound 
source locations is provided by the steepest parts of the slopes. 
These coincide normally with locations directly in front (Stecker 
et al, 2005). In the subcortical neurons described in these previ- 
ous studies, the slope of the tuning curve tended to approach the 
location from which the majority of sounds originated (Dahmen 
et al., 2010; Maier et al, 2012). Thereby, these neurons shift their 
best discrimination ability toward the direction in which most of 
the sound sources reside. Hypothetically, orienting in space could 
have a similar effect, that is, the slope of the spatial tuning curves 
could migrate toward the direction of spatial attention. It remains, 
however, unclear whether such effects can take place in the human 
brain or in response to spatial selective attention. 

One possible reason why location-specific modulation in 
auditory spatial tuning has not been found so far is that the 



enhancement may occur only during very specific task conditions. 
The present and previous studies (Ahveninen et al., 2006; Lee and 
Middlebrooks, 2011) have utilized tasks that do not require the 
subject to discriminate between sound source locations in one 
specific direction. Either spatial attention has been distributed 
or the task has involved other stimulus properties than spatial 
location in the attended direction. In such tasks, a local improve- 
ment in neural selectivity to location is not directly beneficial to 
the performance of the task. Since such a modulation does not 
improve task performance it may not take place. Therefore, in 
order to seek for neural correlates of spatial selective attention in 
the future, it will be important to craft the behavioral task so that 
the neural modulation searched for is directly beneficial for task 
performance. 

Here, no gain effect was found related to the direction of visual 
orientation: responses to the sound in the left were of the same 
amplitude when the subjects oriented visually to the left and to 
the right. Previous EEG studies have found larger negativity in the 
ERPs for sounds originating from visually attended locations than 
from unattended ones (Eimer and Schroger, 1998; Teder-Salejiirvi 
et al., 1999). These increases have, however, occurred at longer 
latencies (150-400 ms) than the Nlm response (peaking at 150 ms 
or earlier) under investigation in the present study. It may well 
be that the gain effect arises from some other mechanism than 
the feature-selective neurons whose activity the stimulus-specific 
adaptation presumably reflects. Further, it is hard to imagine how 
the spatially selective neurons in the auditory cortex with their 
wide receptive fields (approximately 180°, Stecker et al, 2005) 
could produce gain effects that are restricted to narrow ranges of 
locations (less than 20°, Teder-Salejiirvi and Hillyard, 1998). This 
suggests that the gain effect, at least for sound source location, 
may be due to some other neural mechanism. 

In conclusion, the present results show that the representation 
of auditory space in the human cortex can be modulated not only 
by auditory but also by visual tasks. Together with previous stud- 
ies, our findings suggest that enhancements in auditory spatial 
selectivity can occur under diverse conditions, even when sounds 
or spatial locations are not relevant to the task. This suggests 
that the population rate code of auditory space is sensitive to the 
state of the subject perhaps in order to provide improved location 
information of all potentially relevant events in the environment 
under demanding conditions. 
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